A Graph-Based Reinforcement Learning Method with Converged State Exploration and Exploitation

In any classical value-based reinforcement learning method, an agent, despite of its continuous interactions with the environment, is yet unable to quickly generate a complete and independent description of the entire environment, leaving the learning method to struggle with a difficult dilemma of choosing between the two tasks, namely exploration and exploitation. This problem becomes more pronounced when the agent has to deal with a dynamic environment, of which the configuration and/or parameters are constantly changing. In this paper, this problem is approached by first mapping a reinforcement learning scheme to a directed graph, and the set that contains all the states already explored shall continue to be exploited in the context of such a graph. We have proved that the two tasks of exploration and exploitation eventually converge in the decision-making process, and thus, there is no need to face the exploration vs. exploitation tradeoff as all the existing reinforcement learning methods do. Rather this observation indicates that a reinforcement learning scheme is essentially the same as searching for the shortest path in a dynamic environment, which is readily tackled by a modified Floyd-Warshall algorithm as proposed in the paper. The experimental results have confirmed that the proposed graph-based reinforcement learning algorithm has significantly higher performance than both standard Q-learning algorithm and improved Q-learning algorithm in solving mazes, rendering it an algorithm of choice in applications involving dynamic environments

Application of Nickel(II) Complexes to the Efficient Synthesis of α- or β-Amino Acids

Nonproteinogenic α- or β-amino acids have attracted tremendous attention, as they are widely utilized for biological, biochemical, pharmaceutical, and asymmetric chemical investigations. Recently, we developed a series of new strategies for preparing achiral and chiral nickel(ii) complexes for the synthesis of amino acids. We applied these new methods utilizing chiral nickel(ii) complexes for the asymmetric Mannich reaction to synthesize enantiopure α,β-diamino acids, the enantioselective tandem conjugate addition–elimination reaction to prepare glutamic acid derivatives, the Suzuki coupling reaction to yield β2-amino acid derivatives, the asymmetric Mannich reaction to synthesize 3-aminoaspartate, the asymmetric Michael addition reaction to give β-substituted-α,γ-diaminobutyric acid derivatives, the asymmetric alkylation reaction to prepare linear ω-trifluoromethyl containing amino acids, and the asymmetric Michael addition reaction to synthesize syn-β-substituted tryptophans

Lys169 of Human Glucokinase Is a Determinant for Glucose Phosphorylation: Implication for the Atomic Mechanism of Glucokinase Catalysis

Glucokinase (GK), a glucose sensor, maintains plasma glucose homeostasis via phosphorylation of glucose and is a potential therapeutic target for treating maturity-onset diabetes of the young (MODY) and persistent hyperinsulinemic hypoglycemia of infancy (PHHI). To characterize the catalytic mechanism of glucose phosphorylation by GK, we combined molecular modeling, molecular dynamics (MD) simulations, quantum mechanics/molecular mechanics (QM/MM) calculations, experimental mutagenesis and enzymatic kinetic analysis on both wild-type and mutated GK. Our three-dimensional (3D) model of the GK-Mg2+-ATP-glucose (GMAG) complex, is in agreement with a large number of mutagenesis data, and elucidates atomic information of the catalytic site in GK for glucose phosphorylation. A 10-ns MD simulation of the GMAG complex revealed that Lys169 plays a dominant role in glucose phosphorylation. This prediction was verified by experimental mutagenesis of GK (K169A) and enzymatic kinetic analyses of glucose phosphorylation. QM/MM calculations were further used to study the role of Lys169 in the catalytic mechanism of the glucose phosphorylation and we found that Lys169 enhances the binding of GK with both ATP and glucose by serving as a bridge between ATP and glucose. More importantly, Lys169 directly participates in the glucose phosphorylation as a general acid catalyst. Our findings provide mechanistic details of glucose phorphorylation catalyzed by GK, and are important for understanding the pathogenic mechanism of MODY

Bioactive conformational generation of small molecules: A comparative analysis between force-field and multiple empirical criteria based methods

<p>Abstract</p> <p>Background</p> <p>Conformational sampling for small molecules plays an essential role in drug discovery research pipeline. Based on multi-objective evolution algorithm (MOEA), we have developed a conformational generation method called Cyndi in the previous study. In this work, in addition to Tripos force field in the previous version, Cyndi was updated by incorporation of MMFF94 force field to assess the conformational energy more rationally. With two force fields against a larger dataset of 742 bioactive conformations of small ligands extracted from PDB, a comparative analysis was performed between pure force field based method (FFBM) and multiple empirical criteria based method (MECBM) hybrided with different force fields.</p> <p>Results</p> <p>Our analysis reveals that incorporating multiple empirical rules can significantly improve the accuracy of conformational generation. MECBM, which takes both empirical and force field criteria as the objective functions, can reproduce about 54% (within 1Å RMSD) of the bioactive conformations in the 742-molecule testset, much higher than that of pure force field method (FFBM, about 37%). On the other hand, MECBM achieved a more complete and efficient sampling of the conformational space because the average size of unique conformations ensemble per molecule is about 6 times larger than that of FFBM, while the time scale for conformational generation is nearly the same as FFBM. Furthermore, as a complementary comparison study between the methods with and without empirical biases, we also tested the performance of the three conformational generation methods in MacroModel in combination with different force fields. Compared with the methods in MacroModel, MECBM is more competitive in retrieving the bioactive conformations in light of accuracy but has much lower computational cost.</p> <p>Conclusions</p> <p>By incorporating different energy terms with several empirical criteria, the MECBM method can produce more reasonable conformational ensemble with high accuracy but approximately the same computational cost in comparison with FFBM method. Our analysis also reveals that the performance of conformational generation is irrelevant to the types of force field adopted in characterization of conformational accessibility. Moreover, post energy minimization is not necessary and may even undermine the diversity of conformational ensemble. All the results guide us to explore more empirical criteria like geometric restraints during the conformational process, which may improve the performance of conformational generation in combination with energetic accessibility, regardless of force field types adopted.</p

Molecular Determinants of Magnolol Targeting Both RXRα and PPARγ

Nuclear receptors retinoic X receptor α (RXRα) and peroxisome proliferator activated receptor γ (PPARγ) function potently in metabolic diseases, and are both important targets for anti-diabetic drugs. Coactivation of RXRα and PPARγ is believed to synergize their effects on glucose and lipid metabolism. Here we identify the natural product magnolol as a dual agonist targeting both RXRα and PPARγ. Magnolol was previously reported to enhance adipocyte differentiation and glucose uptake, ameliorate blood glucose level and prevent development of diabetic nephropathy. Although magnolol can bind and activate both of these two nuclear receptors, the transactivation assays indicate that magnolol exhibits biased agonism on the transcription of PPAR-response element (PPRE) mediated by RXRα:PPARγ heterodimer, instead of RXR-response element (RXRE) mediated by RXRα:RXRα homodimer. To further elucidate the molecular basis for magnolol agonism, we determine both the co-crystal structures of RXRα and PPARγ ligand-binding domains (LBDs) with magnolol. Structural analyses reveal that magnolol adopts its two 5-allyl-2-hydroxyphenyl moieties occupying the acidic and hydrophobic cavities of RXRα L-shaped ligand-binding pocket, respectively. While, two magnolol molecules cooperatively accommodate into PPARγ Y-shaped ligand-binding pocket. Based on these two complex structures, the key interactions for magnolol activating RXRα and PPARγ are determined. As the first report on the dual agonist targeting RXRα and PPARγ with receptor-ligand complex structures, our results are thus expected to help inspect the potential pharmacological mechanism for magnolol functions, and supply useful hits for nuclear receptor multi-target ligand design

Mechanics of Channel Gating of the Nicotinic Acetylcholine Receptor

The nicotinic acetylcholine receptor (nAChR) is a key molecule involved in the propagation of signals in the central nervous system and peripheral synapses. Although numerous computational and experimental studies have been performed on this receptor, the structural dynamics of the receptor underlying the gating mechanism is still unclear. To address the mechanical fundamentals of nAChR gating, both conventional molecular dynamics (CMD) and steered rotation molecular dynamics (SRMD) simulations have been conducted on the cryo-electron microscopy (cryo-EM) structure of nAChR embedded in a dipalmitoylphosphatidylcholine (DPPC) bilayer and water molecules. A 30-ns CMD simulation revealed a collective motion amongst C-loops, M1, and M2 helices. The inward movement of C-loops accompanying the shrinking of acetylcholine (ACh) binding pockets induced an inward and upward motion of the outer β-sheet composed of β9 and β10 strands, which in turn causes M1 and M2 to undergo anticlockwise motions around the pore axis. Rotational motion of the entire receptor around the pore axis and twisting motions among extracellular (EC), transmembrane (TM), and intracellular MA domains were also detected by the CMD simulation. Moreover, M2 helices undergo a local twisting motion synthesized by their bending vibration and rotation. The hinge of either twisting motion or bending vibration is located at the middle of M2, possibly the gate of the receptor. A complementary twisting-to-open motion throughout the receptor was detected by a normal mode analysis (NMA). To mimic the pulsive action of ACh binding, nonequilibrium MD simulations were performed by using the SRMD method developed in one of our laboratories. The result confirmed all the motions derived from the CMD simulation and NMA. In addition, the SRMD simulation indicated that the channel may undergo an open-close (O ↔ C) motion. The present MD simulations explore the structural dynamics of the receptor under its gating process and provide a new insight into the gating mechanism of nAChR at the atomic level

Structure-Activity Relationship and Substrate-Dependent Phenomena in Effects of Ginsenosides on Activities of Drug-Metabolizing P450 Enzymes

Ginseng, a traditional herbal medicine, may interact with several co-administered drugs in clinical settings, and ginsenosides, the major active components of ginseng, may be responsible for these ginseng-drug interactions (GDIs). Results from previous studies on ginsenosides' effects on human drug-metabolizing P450 enzymes are inconsistent and confusing. Herein, we first evaluated the inhibitory effects of fifteen ginsenosides and sapogenins on human CYP1A2, CYP2C9, CYP2C19, CYP2D6 and CYP3A4 enzymes by using commercially available fluorescent probes. The structure-activity relationship of their effects on the P450s was also explored and a pharmacophore model was established for CYP3A4. Moreover, substrate-dependent phenomena were found in ginsenosides' effects on CYP3A4 when another fluorescent probe was used, and were further confirmed in tests with conventional drug probes and human liver microsomes. These substrate-dependent effects of the ginsenosides may provide an explanation for the inconsistent results obtained in previous GDI reports

Two adjacent mutations on the dimer interface of SARS coronavirus 3C-like protease cause different conformational changes in crystal structure

AbstractThe 3C-like protease of SARS coronavirus (SARS-CoV 3CLpro) is vital for SARS-CoV replication and is a promising drug target. It has been extensively proved that only the dimeric enzyme is active. Here we discovered that two adjacent mutations (Ser139_Ala and Phe140_Ala) on the dimer interface resulted in completely different crystal structures of the enzyme, demonstrating the distinct roles of these two residues in maintaining the active conformation of SARS-CoV 3CLpro. S139A is a monomer that is structurally similar to the two reported monomers G11A and R298A. However, this mutant still retains a small fraction of dimer in solution, which might account for its remaining activity. F140A is a dimer with the most collapsed active pocket discovered so far, well-reflecting the stabilizing role of this residue. Moreover, a plausible dimerization mechanism was also deduced from structural analysis. Our work is expected to provide insight on the dimerization–function relationship of SARS-CoV 3CLpro

Emodin targets the β-hydroxyacyl-acyl carrier protein dehydratase from Helicobacter pylori: enzymatic inhibition assay with crystal structural and thermodynamic characterization

<p>Abstract</p> <p>Background</p> <p>The natural product Emodin demonstrates a wide range of pharmacological properties including anticancer, anti-inflammatory, antiproliferation, vasorelaxant and anti-<it>H. pylori </it>activities. Although its <it>H. pylori </it>inhibition was discovered, no acting target information against Emodin has been revealed to date.</p> <p>Results</p> <p>Here we reported that Emodin functioned as a competitive inhibitor against the recombinant β-hydroxyacyl-ACP dehydratase from <it>Helicobacter pylori </it>(HpFabZ), and strongly inhibited the growth of <it>H. pylori </it>strains SS1 and ATCC 43504. Surface plasmon resonance (SPR) and isothermal titration calorimetry (ITC) based assays have suggested the kinetic and thermodynamic features of Emodin/HpFabZ interaction. Additionally, to inspect the binding characters of Emodin against HpFabZ at atomic level, the crystal structure of HpFabZ-Emodin complex was also examined. The results showed that Emodin inhibition against HpFabZ could be implemented either through its occupying the entrance of the tunnel or embedding into the tunnel to prevent the substrate from accessing the active site.</p> <p>Conclusion</p> <p>Our work is expected to provide useful information for illumination of Emodin inhibition mechanism against HpFabZ, while Emodin itself could be used as a potential lead compound for further anti-bacterial drug discovery.</p